Quantifying Benefit and Cost of Erasure Code based File Systems
نویسندگان
چکیده
We perform a quantitative analysis of the costs and benefits of using file systems whose long term reliability methods are based on erasure codes. We compare it with replication a special case of erasure codes that is used in many reliable file systems. Our main goal in benefit analysis is to see how much of an increase in the expected system lifetime can be achieved with erasure codes or the storage requirement decreased given the same system lifetime requirement as a replicated system. Our main goal in cost analysis is to model the effect of erasure codes on latency and throughput of the system taking into factor code properties like decoding time and complexity. We also present a case study where we use previously measured values for the parameters of our modeled system to get an idea of the behavior of a real system.
منابع مشابه
A Non-MDS Erasure Code Scheme for Storage Applications
This paper investigates the use of redundancy and self repairing against node failures indistributed storage systems using a novel non-MDS erasure code. In replication method, accessto one replication node is adequate to reconstruct a lost node, while in MDS erasure codedsystems which are optimal in terms of redundancy-reliability tradeoff, a single node failure isrepaired after recovering the ...
متن کاملA Model for Runway Landing Flow and Capacity with Risk and Cost Benefit Factors
As the demand for the civil aviation has been growing for decades and the system becoming increasingly complex, the use of systems engineering and operations research tools have shown to be of further use in managing this system. In this study, we apply such tools in managing landing operations on runways (as the bottleneck and highly valuable resources of air transportation networks) to handle...
متن کاملGPU Erasure Coding for Campaign Storage
High-performance computing (HPC) demands high bandwidth and low latency in I/O performance leading to the development of storage systems and I/O software components that strive to provide greater and greater performance. However, capital and energy budgets along with increasing storage capacity requirements have motivated the search for lower cost, large storage systems for HPC. With Burst Buff...
متن کاملOn the I/O Costs of Some Repair Schemes for Full-Length Reed-Solomon Codes
Network transfer and disk read are the most time consuming operations in the repair process for node failures in erasure-code-based distributed storage systems. Recent developments on Reed-Solomon codes, the most widely used erasure codes in practical storage systems, have shown that efficient repair schemes specifically tailored to these codes can significantly reduce the network bandwidth spe...
متن کاملRethinking erasure codes for cloud file systems: minimizing I/O for recovery and degraded reads
To reduce storage overhead, cloud file systems are transitioning from replication to erasure codes. This process has revealed new dimensions on which to evaluate the performance of different coding schemes: the amount of data used in recovery and when performing degraded reads. We present an algorithm that finds the optimal number of codeword symbols needed for recovery for any XOR-based erasur...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007